Solving Hidden Non-markovian Models: How to Compute Conditional State Change Probabilities
نویسندگان
چکیده
Current production systems produce a wealth of information in the form of protocols, which is hardly exploited, often due to a lack of appropriate analysis methods. Hidden non-Markovian Models attempt to relieve this problem. They enable the analysis of not observable systems only based on recorded output. The paper implements and tests solution algorithms based on the original Hidden Markov Model algorithms. The problem of computing the conditional state change probabilities at specific points in time is solved. The implemented algorithms compute the probability of a given output sequence and the most probable generating path for Markov regenerative models. This enables the analysis of protocols of not observable systems and the solution of problems that cannot be solved using existing methods. This opens up new application areas, including a different approach to mining the wealth of data already collected today with huge monetary effort.
منابع مشابه
Markovian Models for Sequential Data
Hidden Markov Models HMMs are statistical models of sequential data that have been used successfully in many machine learning applications especially for speech recognition Further more in the last few years many new and promising probabilistic models related to HMMs have been proposed We rst summarize the basics of HMMs and then review several recent related learning algorithms and extensions ...
متن کاملQuantifying and localizing state uncertainty in hidden Markov models using conditional entropy profiles
A family of graphical hidden Markov models that generalizes hidden Markov chain (HMC) and tree (HMT) models is introduced. It is shown that global uncertainty on the state process can be decomposed as a sum of conditional entropies that are interpreted as local contributions to global uncertainty. An efficient algorithm is derived to compute conditional entropy profiles in the case of HMC and H...
متن کاملMonte Carlo Simulation to Compare Markovian and Neural Network Models for Reliability Assessment in Multiple AGV Manufacturing System
We compare two approaches for a Markovian model in flexible manufacturing systems (FMSs) using Monte Carlo simulation. The model which is a development of Fazlollahtabar and Saidi-Mehrabad (2013), considers two features of automated flexible manufacturing systems equipped with automated guided vehicle (AGV) namely, the reliability of machines and the reliability of AGVs in a multiple AGV jobsho...
متن کاملConsistency of the Maximum Likelihood Estimator for General Hidden Markov Models
Abstract. Consider a parametrized family of general hidden Markov models, where both the observed and unobserved components take values in a complete separable metric space. We prove that the maximum likelihood estimator (MLE) of the parameter is strongly consistent under a rather minimal set of assumptions. As special cases of our main result, we obtain consistency in a large class of nonlinea...
متن کاملComputing Conditional Probabilities in Markovian Models Efficiently Extended Version
The fundamentals of probabilistic model checking for Markovian models and temporal properties have been studied extensively in the past 20 years. Research on methods for computing conditional probabilities for temporal properties under temporal conditions is, however, comparably rare. For computing conditional probabilities or expected values under ω-regular conditions in Markov chains, we intr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009